A Metropolized Adaptive Subspace Algorithm for High-Dimensional Bayesian Variable Selection
نویسندگان
چکیده
A simple and efficient adaptive Markov Chain Monte Carlo (MCMC) method, called the Metropolized Adaptive Subspace (MAdaSub) algorithm, is proposed for sampling from high-dimensional posterior model distributions in Bayesian variable selection. The MAdaSub algorithm based on an independent Metropolis-Hastings sampler, where individual proposal probabilities of explanatory variables are updated after each iteration using a form learning, way that they finally converge to respective covariates' inclusion probabilities. We prove ergodicity present parallel version with adaptation scheme combination information multiple chains. effectiveness demonstrated via various simulated real data examples, including problem more than 20,000 covariates.
منابع مشابه
Combining a relaxed EM algorithm with Occam's razor for Bayesian variable selection in high-dimensional regression
We address the problem of Bayesian variable selection for high-dimensional linear regression. We consider a generative model that uses a spike-and-slab-like prior distribution obtained by multiplying a deterministic binary vector, which traduces the sparsity of the problem, with a random Gaussian parameter vector. The originality of the work is to consider inference through relaxing the model a...
متن کاملAn Algorithm for Bayesian Variable Selection in High-dimensional Generalized Linear Models
Inspired by analysis of genomic data, the primary quest is to identify associations between studied traits and genetic markers where number of markers is typically much larger than sample size. Bayesian variable selection methods with Markov chain Monte Carlo (MCMC) are extensively applied to analyze such high-dimensional data. However, MCMC is often slow to converge with large number of candid...
متن کاملBayesian Variable Selection in Clustering High-Dimensional Data With Substructure
In this article we focus on clustering techniques recently proposed for highdimensional data that incorporate variable selection and extend them to the modeling of data with a known substructure, such as the structure imposed by an experimental design. Our method essentially approximates the within-group covariance by facilitating clustering without disrupting the groups defined by the experime...
متن کاملOn the Computational Complexity of High-Dimensional Bayesian Variable Selection
We study the computational complexity of Markov chain Monte Carlo (MCMC) methods for high-dimensional Bayesian linear regression under sparsity constraints. We first show that a Bayesian approach can achieve variable-selection consistency under relatively mild conditions on the design matrix. We then demonstrate that the statistical criterion of posterior concentration need not imply the comput...
متن کاملConsistent high-dimensional Bayesian variable selection via penalized credible regions.
For high-dimensional data, particularly when the number of predictors greatly exceeds the sample size, selection of relevant predictors for regression is a challenging problem. Methods such as sure screening, forward selection, or penalized regressions are commonly used. Bayesian variable selection methods place prior distributions on the parameters along with a prior over model space, or equiv...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Bayesian Analysis
سال: 2022
ISSN: ['1936-0975', '1931-6690']
DOI: https://doi.org/10.1214/22-ba1351